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Abstract: 

We present an interactive system organized around networks of 
constraints rather than the programs which manipulate them. We describe a 
language of hierarchical constraint networks. We describe one method of 
deriving useful consequences of a set of constraints which we call 
propagation. Dependency analysis is used to spot and track down 
inconsistent subsets of a constraint set. Propagation of constraints is 
most flexible and useful when coupled with the ability to perform symbolic 
manipulations on algebraic expressions. Such manipulations are in turn 
best expressed as alterations or augmentations of the constraint network 
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Introduction 

romn„t a ,- r0gr T in9 lang - uages are usua Hy organized around unilateral 
nroclurP ° n " h 9PamS Perf ° rm predete ™^ operations on their inputs to 
produce desired outputs or to evolve a desired process. Physical systems 

.evera'i iTrZJ^' /" USUaUy SP6Cified aS SetS ° f con^r.inU tZn' 9 
several variables. A constraint such as x*y + z=3 is no more about how to 

compute x given y and z than it is about how to compute z giyen x and y 

conJt™J„t a , re ZT WriUen h*° GXtraCt US6fUl info ™ at "" fr« a set of 
constraints. Such programs depend strongly on the forms of the constraints 

and are committed to solving for particular variables. For example 

Surr 1 clrcuit anaiysis are usuauy not go ° d f - ^ 

We present an interactive system organized around networks of 
constraints rather than the programs which manipulate them. We describe a 
language of hierarchical constraint networks. It supplies a set 01 

svst e ms Ve hv COnS r int tyPCS 9nd a meanS ° f building compound constraint 

thi kind cnn f n / n9 H lnStan , CeS ° f SimPl6r ° neS - """faint networks of 
this kind can often be used to elegantly describe the specifications of 

ohv ; 1 Pt "? ramS and data Structures as W *H a* mathematical models of 

pnysicai systems. 

We also describe one method of deriving useful consequences of a 

nfirtv° n f raint / , WhiCh ^ CaU propagatidn ' Propagation automatically 

s nor „r T ° the Sparseness of most constraint networks. Propagation 

set of u E2 r " ^ t0 S ° 1Vin9 f ° r any P articula r Predetermined 

set of unknowns, nor is it committed to using any particular constraint in 

wi , the e TddTtioT y V ^ f3Ct Pr ° Pagati0n anal * sis «y ^ freely intermixed 
with the addition of new constraints and the deletion of old ones This 
requires that the system keep track of how its conclusion Und 
intermediate results) are consequences of the particular const s they 

i c ns istln" sTslt ^T™* analySi * U al " UMd "° SPOt and track d °»" 
most f exib p ah H J , c \ C0nstraint set - Propagation of constraints is 
most flexible and useful when coupled with the ability to perform symbolic 
manipulations on algebraic expressions. Such manipulations are TJurn 
best expressed as alterations or augmentations of the constraint network 

The Language of Constraints 

A language is a means of communication of ideas. A lanauaae 
generally has a "theme", the class of ideas which it is optimized ?or 
communicating. For example, most computer languages are designed for 
expressing algorithms They are optimized for communicating imperative 
procedural notions. < other Languages) _. -ting imperative, 

declanHvo Tfr . ^ , ,ne tneme of the constraint language is 

declarative. it is good for expressing descriptions of structural 
relationships and physical situations. structural 
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Every language has a set of primitive entities which represent the 
elementary notions of the domain, and rules of composition by which 
compound entities are constructed. 



Simple Constraints 

We will now proceed to illustrate the entities of the constraint 

language by an annotated interaction with the constraint language 

interpreter. Input to the interpreter is in lower case, following the 
prompt "==>". 



/*■% 



One kind of primitive (i.e., built-in) constraint we might have is 
an "adder" which constrains three numbers (called the addend, augend, and 
sum of the adder) in such a way that the addend plus the augend must equal 
the sum. Put another way, it constrains the augend to equal the difference 
of the sum and the addend. (The point is that there is no preferred 
direction of computation.) First, let's make an adder, called ZAP: 



==> (create zap adder) 

ZAP 



=E> 



ZAP 



Every object in the constraint language has a type, and 'may have parts, 
can ask ZAP to tell us about itself: 



We 



==> (>> type? zap) 
ADDER 

==> (>> partnames? zap) 
(Al A2 SUM) 



ZAP 



It seems that ZAP has three parts, the addend (ai), the augend (A2), and 
the sum (sum). The parts also have types. 



• = = > (>> type? al zap) 
CELL 

==> (>> partnames? al zap) 
NIL 



A cell is a primitive entity which hath no parts. (E1ements} Cells are used 
for two things in the constraint language. They are used to hold 
computational values, and (as we will see later) they can be connected 
together when building compound constraints. We can use WHAT-IS to 
discover the value in a cell: 
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==> (what-is (>> sum zap)) 
Sorry, I don't know it. I need: 

(>> Al ZAP) 

(>> A2 ZAP) 
to use rule: (>> RULE#1 ZAP) 

At this point, the system does not know a value for the sum of ZAP 
However it has told us that if we had given it the ai and A2 it could have 
c«put.d a su m U si„ g a rule internal to ZAP. Instead. „ „„ w "i ve the "Z 



==> (set-parameter (>> sum zap) 5.0) 
5.0 

==> (what-is (>> sum zap)) 
(>> SUM ZAP) = 5.0 




==> (why (>> S um zap)) 
Because you told me so. 

Wow that the system knows about the sum of ZAP, can it tell us about the 

**> (what-is (>> al zap )) 

Sorry, I don't know it. I need: ; 

(>> A2 ZAP) 
to use rule: (>> RULE#2 ZAP) 

The ai is not yet completely determined, but it could be determined if the 
A2 were known. If instead we specify the ai, the A2 should be determined. 



==> (set-parameter (>> al zap) -2.0) 
-2.0 

==> (what-is (>> a2 zap)) 
(>> A2 ZAP) = 7.0 



7,0 

L 



^-^ ZAP 



==> (why (>> a2 zap)) 

I used rule (>> RULE#3 ZAP) on the following inputs: 
(>> SUM ZAP) 
(>> Al ZAP) 



^"*\ 



the constraint i lllustr f ** the use of an adder, a typical entity of 

er r^H lan f/9 e - A constraint enforces a relationship among 

several entities. If enough information is known to immediately deduce 

unknown cell values, those values are computed. These new values mav 

IwlUZT T? \T ^ CaU thiS dedUCUVe ™ "P-P^Uon^ 

neXrs%;„,^v; t a , l . 1 , y ' " is values that are pro — d ' «™»" • 
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Networks of Constraints 

Suppose we also have a kind of constraint called a "multiplier- 
Mi 

==> (create f oo mul tipl ier ) 
F00 



Ml s^ 

$> 

Ml <r 



FHOOMCT 



Neither an adder by itself nor a multiplied by itself i* * 

Algorithms can be temporally concatenated (sequencing) selected 1 

(con monals), and iterated (do loops). Data flow is 7ndicated explicU y 

In the constraint language, a compound constraint is built from 

" ratio„\ at^o'enVr °' ^ "^ ^ ^ ° f »"»«»« * 

ui-ciaration that two entities are in fact the same. 

entities™? th7Lrr tiV \ all ° WS US t0 identify any tw ° constraint 
entities of the same type. In particular, if two cells are identified they 

ha r :e\l eC s t :;: 1 v y alu°e n . Sidered t0 ^ " e '~ CeU " th - - constrain d ed h ^ 

ass > (" (>> product foo) (>> al zap)) 
IDENTITY 

B8S > (== (>> ml foo) (>> a2 zap)) 
IDENTITY 

For, Th We ha 7 linked Vari ° US PartS of our adder ZAP "d our multiplier 
FOO. The resulting network looks like: xpuer 



7.0 



Ml 



M2 



Foo 



PRODUCT 



TAP 



© 
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Now ZAP had some values in its cells when we linked them to FOO's 
cells. These values have already been propagated through FOO. 

»=> (what-is (>> mZ foo)) ~ 
(>> M2 FOO) = -0.285714287 

==> (why (>> m2 foo)) 

I used rule (» RULE#5 FOO) on the following inputs: 

(>> PRODUCT FOO) 

(>> Ml FOO) 

We can chase these deductions to their ultimate reasons. 

==> (why (>> product foo)) 

I used rule (>> 1<=2) on the following inputs: 
(>> Al ZAP) 

The rule ''l< = 2" is a manifestation of the linkage between the product of FOO 
and the ai of ZAP. 

es > (why (>> al zap)) 
Because you told me so. 

s »> (why (>> ml foo)) 

I used rule (>> 1<=2) on the following inputs: ' 
(>> A2 ZAP) 

==> (why (>> a2 zap)) 

I used rule (>> RULE#3 ZAP) on the following inputs: 

(>> SUM ZAP) 

(>> Al ZAP) 

It is often convenient to be able to determine the ultimate antecedents of 
a deduced value. For example, we know the value of the M2 of FOO because 
of a chain of deductions ultimately derived from our knowledge of the sum 
and ai of ZAP. . 

==> (premises (>> m2 foo)) 
(>> SUM ZAP) = 5.0 
(>> Al ZAP) = -2.0 

If we change a premise all conclusions which depended upon it are 
automatically retracted and new conclusions are drawn. In a large network 
only a few values may depend on any one premise. The constraint language 

d^l,l r r etGr ret T tS ° nly th ° Se ValUeS and 0nly the incremental new 
deductions are made. 
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==> (change-parameter (>> al zap) 2.0) 
2.0 

* = > (what-is (>> a2 zap))"" 
(>> A2 ZAP) = 3.0 

= = > (what-is (>> mZ Too)) 
(>> M2 FOO) = 0.666666664 



J2. 

3 



o 25 *6€6. 






3.0 



B — © 

•"ZAP 







We cannot so easily change a parameter whose value is a consequence of 
other known facts. One of the premises upon which the changing parameter 
depends must be abandoned... The system automatically chases down only the 
relevant premises and gives us a choice of which we want to retract. 

==> (change-parameter (>> a2 zap) 19.0) 
Which of the following assumptions will you change? 
1 (>> Al ZAP) r 2.0 
. 2 .(>> SUM ZAP) = 5.0 
ANSWER: 

Before allowing the system to change anything, we may want to investigate 

the repercussions of changing it. (Note that the prompt has changed to 

--> indicating that the system is waiting for an answer to its question.) 

--> (results (>> sum zap)) 

Rule (>> RULE03 ZAP) got (>> A2 ZAP) * 3.0 

--> (results (>> al zap)) 

Rule (>> 1<=2) got (>> PRODUCT FOO) * 2.0 

Rule (>> RULE#3 ZAP) got (>> A2 ZAP) = 3^0 

We decide to retract assumption #1, that the ai of ZAP is 2.0. 

--> (answer 1) 
19 .0 



The system finished changing the parameter to 19 and restored the prompt to 
= = > • The new value of the m of FOO is now: 
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==> (what-is (>> m2 foo)) 
(»• M2 FOO) = -0.7368421 

The new situation is: 



© 



if 






ZAP 




-IH.0 



Local constraint propagation cannot solve everv nmhiom „r 
assigning values to cells in our network. Sometimes a more global an al vsJl 
is necessary. For example, if we change the value of the « of FW Jo J" 
and we release the premise concerning the value of the A2 of p V \ 
consistent value that either the „ or the A2 of ZAP can take on is z 5. * 

==> (change-parameter (>> m 2 foo) 1.0) 

Which of the following assumptions will you change? 

1 (>> A2 ZAP) = 19.0 

2 (>> SUM ZAP) = 5.0 
ANSWER: 



--> (answer 1) 
1.0 



e-% 



ZAP 



==> (what-is (>> al zap)) 
Sorry, I don't know it. I need: 

(>> PRODUCT FOO) 
to use rule: (>> 2<=1) 
or t I need : 

(>> A2 ZAP) 
•to use rule: ($> RULE#2 ZAP) 

F oo, we^:t^™^r rk cannot detsrmine *• pmuct ° f 



/*"*\ 
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«> (change-parameter (» product foo) 17.0) 
Contradiction... disputants are: 

(>> PRODUCT FOO) = 17.0 

(>> CHALLENGER: RULE#3>00) = -1?. 
Choose an assumption to change: 

1 (>> m FOO) = i.o 

2 (»• SUM ZAP) = 5.0 
ANSWER: 



#•% 




FOO y- [\7.o\ 

COWTR4PJCTION! 

iHzTa'now, ^ T? V ° f makin9 the assum P ti0 " that the product of FOO 
is 17.0 allows the deduction that the product of FOO must (also) be -12 
given the other assumptions in force. This immediate contradiction li 
noticed, and the system presents us with a choice of actions 

--> (answer 2) 
17.0 



We have chosen to discard 

==> (what-is (>> sum zap)) 
(>> SUM ZAP) = 34.0 
==> (what-is (>> aZ zap)) 
(>> A2 ZAP) = 17.0 



assumption 2, and the network readjusts itself. 



e-=fe 



j 7,0 



ZAP 



SH.O 







also seen „„„ it ls possible t0 J dent ir ™ >°" °' P^U We have 

-™rt— ^^ 

important ,. the system for effieiee, e . „t, U„„ as „e sh a U III]" ^ 
are „se ful ret „ehu gg i„ g ptoses. a„e foe helplng U a S TJ"^^ »£ 



Steele and Sussman 



Constraints 



/ m \ 



behavior of his constraint network. We believp that thic < ... 

Abstraction and Hierarchy 

, . ai Wlt " thls complexity, we need a way to break nn i-,,-™ 
networks into meaningful pieces If w* a r- D i. u P arge 

will be the same, and 3 can ^^id ^.C.T.SiCbl^,'!:"" Moner 



can build arbitrarily complicated compound objects in a hierarchy*! 

nmned. T " e hicrarc,,y allows thc «=-"•*"" " •"'•«. i.A? r »"i 

there is'" ro^Tf 9 ",, T" 1 ^ Pe ™" thls Un<1 of Hierarchical definition 
le trenod A '""taction, which specifies how a compound object is to 

between the specified combination ,„d V.' oxter ^ppeara"" f^b" 

abstraction as a single object. <Lambda >. 

The constraint language provides a rule of abstraction which allow* 

specifications for linking them. When a pattern is instantiated th! 
designated components are recursively instantiated and I then Jink.! 
according to the "==•• specifications. llnked 

kind nf ? r 6Xa T le * we can combine adders and multipliers to produce a 
kind of compound contraint called a "resistor" An M rfaal x proauce a 

=^ z izxr^Tzz™ co„ - airiLTr- ^: 
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i t + i 2 = o 



We notate this as follows: 

==> (constraint resistor 

((vl number) 





RESISTOR 



(v2 number) 

(il number) 

(i2 number) 

(resistance number) 

(av adder)' 

(ai adder) 

(m mul tip! ier) ) 

= =' vl (>> sum av)) 

== v2 (>> al av)) 

== (>> a2 av) (>> product m)) 

== il (>> ml m)) 

== resistance (>> m2 m)) 

== il (>> al ai)) 

=* 12 (>> a2 ai)) 

constant (>> sum ai ) 0.0)) 




The keyword "constraint" is followed by a name, a list of component names 
and types and a set of linkages. The expression (constant <,on,.thm B > < value » 
value (TMn?^? 110 * 1 f ° r f ° rcing <someth ^> t0 ^ve the given computational 



With this definition we can make a resistor in the s 
make an adder: 



ame way that we 



==> (create r43 resistor) 
R43 



L h s i t,ntia S t 1 S nn R/5 tH t0 "V "^ ° f *" ^^ ° f the Pattern RESIS ™- In 
instantiating the pattern, instances of components such as adders and 

multip ers are also effectively created. We can use instances of s1st 
to builci a voltage divider: resistor 
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==> (creater44 resistor) 

R44 

s -> (create kcll adder) 

KCL1 

= = > (== (>> v2 r43) (>) vl r44)) 

IDENTITY 

= = > (== (>> 12 r43) (>> al kcll)) 

IDENTITY 

= = > (== (>> il r44). (>> a2 kcll)) 

IDENTITY 

==> (constant (>> sum kcll) 0,0) 

0.0 



J L 




T — T 



It is silly to use adders and numerical connectors to hook together 
resistors. We should not be mixing conceptual levels. In the world of 
electrical circuits, elements like resistors have terminals which connect 
to nodes. A terminal has a potential ("voltage") on it and a current into 
it, packaged up together. A node connects two or more terminals so as to 
constrain their potentials to be the same, and the sum of the currents into 
them to be zero. 



-«> (constraint terminal ((v number) (i number))) 

TERMINAL 



6v ib 



The "terminal" constraint is trivial. All it does is package up two 
numbers so that they can be referred to as a unit. 

TI 

==> (constraint 2-node 

((tl terminal) 



f 



2-NODE 



( t2 terminal ) 

(kcl adder)) 
<« (>> v tl) (» v t2)) 
(== (>> i tl) (>> al kcl)) 
(== (>> i t2) (>> a2 kcl)) 
(cpnstant (>> sum kcl ) 0.0)) 




T2. 



A 2-node" is a two-terminal node. It has an adder for enforcing the sum- 
of- currents constraint (Kirchoff's Current Law). The equal-potentials 
constraint (kirchoff's Voltage Law) is enforced by direct identificatic 



Lon. 
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=-> (constraint resistor 



J T1 




( ( tl terminal ) 
( t2 terminal ) 


r R 


(resistance number) 
(av adder) 


'tz 


(ai adder) 

(m multiplier)) 




(= = (>> v tl) (>> sum av)) 


i^« 




(== (>> v U) (>> al av)) 


t 




(= = (>> a2 av) (>> product m)) 


* 


_R 


(= = (>> i tl) (>> ml m)) 
(= = resistance (>> m2 m)) 
(== (>> i tl) (>> al ai)) 


It* 




(== (>> i t2) (>> a2 ai)) 




1 (constant (*>> sum ai) 0.0)) 


RESISTOR 








This definition is as before, except that terminals are used. 

Now we can simply create two resistors and a 2-node, and connect 
thera up by identifying the terminals of resistors with terminals of the 
node. 



==> (create r43 resistor) 

R43 

=-> (create r44 resistor) 

R44 

= -> (create n2 2-node) 

N2 

= = > (== (>> tl r44) (>> t2 n2)) 

IDENTITY 

= = > (== (>> t2 r43) (» tl n2)) 

IDENTITY 




In the 'constraint language, it is possible to identify compound 
constraints, using "==", in exactly the same way that primitive objects 
like numbers are identified. The meaning of equality for compound objects 
is that two objects are equal if their corresponding components are equal. 
Thus when two terminals are made equal, their voltages are identified, and 
so are their currents. 



^*s 



(In the examples involving electrical components we have been, and 
will be, carefully skirting a difficult issue regarding the directions of 
currents. In the constraint language, things "connected together" are 
identified as being the same thing. In the electrical world, while 
electrically connecting two electrical terminals makes their voltages the 
same (Kirchoff's Voltage Law), it does not make their currents the same. 
The currents are instead subject to the more complex constraint that they 
must sum to zero. This is the reason we use nodes as an intermediate 



^0***K 
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^ k e e n e f D 0r th n9 KirCh ° ff ' S CUrrent UW - N0des ™»t b. used 

descr b ng eXectrTca^,^"" 1 "IT 10 " 3 Straight - ™° constraints 
connect 3 through a nSe AdrfT n """^ COnnected > »>ut must be 

recict-nr Th^ ^i u uiviuer, ana the resistance of one 

-.s .^.■r 1 ^c c .T, , r :*^ f ^r " - ui tt - — - 

= = > (set-parameter (>> v X2 r44 ) 0.0) 
0.0 

==> (set-parameter (>> v tl r44) 3.0) 
3.0 ' 

= = > (set-parameter (>> v tl r43) 10,0) 
10.0 

«> (.set-parameter (>> resistance r44) 9 0) 
9.0 

==> (what-is (>> resistance r43)) 
(>> RESISTANCE R43) = 21.0 

This is similar to computations we have already seen. The Veal work" is 

southing 5 5 r! ; D !:;- b f i pr T: s wlth not bein! ' able to «""« 



==> (forget-parameter (>> v tl r44)) 

NIL 

= *> (set-parameter (>> resistance r43) 21 0) 
21.0 

==> (what-is (>> v tl r44)) 
Sorry, I don't know it. I need: 

(>> V T2 N2) 
to use rule: (>> 1< = 2) 
or, I need: 

(>> SUM AV R44) 
to use rule: (>> l< = 2 R44) 



resistance of R43, which had been deduced from this «nH ano D • \\ 

the r .. lstMc . valtt . should permlt the dedu ™ n ^ xi<z m T v lT™, 
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h ZtJ\ b6f0re thlS Cann0t be d °" e l0cally by the constraints. There are 

Jit" ^Tu^ Pr ° blem - ° ne iS t0 intr ° duce -Itiple v e's o 
the circuit, we will examine this technique in the next section. Another 

later USe Symb ° llC al ^ bra in the computations; this will be ex^ine" 



Almost-Hierarchical Systems 

a system° for P Th r p fU1, * ^^ "" "*** ™ P ° S * * conce P tua l structure on 
unrior,t h- PUPP0Se ° f Umiting the c °»<Plexity involved in 

understanding or designing it. If a system cannot be immediately 

" c e es Ine^ 1 ' 56 ^ 1 "^ ^ " GeStalt,,) then " ™ St b * ^ -deTstood n 
Pieces. The descriptive structure directs attention to sets of components 
of the system which together constitute a single conceptual piece. 

less dionfnt a H Sy f 6 K ^ be .P artitione d into pieces which are more or 
less disjoint and which together cover the entire system. The total system 
can be understood by understanding the pieces and by understanding thJ 
composition by which the pieces constitute the system. Similarly each 
Piece may be similarly partitioned. In this way we derive single' tree- 
like decomposition of the system. Such a tree we call a hierarchy 

useful n r * tl i !. llkely ' r h0WeVer ' th3t at any Sta 9 e there " more than one 
^uff 1 I r 1 " 9 ° f a PiGCe - If S °' then a si "9 le hierarchy does not 

suffice to indicate all the conceptual pieces of interest in the system 
Pieces whose sub-pieces are localized within one hierarchy will probably 
have its sub-pieces widely dispersed throughout another. P™bably 

For example, a mechanical timepiece has among its major parts a 
mainspring, several wheels or "gears" (main, center, third, fourth hour 

h'nT' These eSCaP r WhGelS) ' * U ™' * bala ^ a i-Pring' asslmbl'y nd 
hands These parts are usually grouped into sets which are physically 
connected: the mainspring and main wheel together form the ba 
center, hour, and minute wheels plus the hands form the motion works' the 
main, center, third, fourth, and escape wheels form the wheel train.' and 

e-xUpie ^a" ^ ^ "' th "" 1 ™ C ™^« "- P 
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ZlTZ\Z?J s sme overlap bet " een th0 - 1B «™«-»-« o^pi- 

deconposiMoi'T 16 " '^ "" ^ f """ 1 °"* 1 'V ""'»•« •• • ""fold 



£A/ER<SY 
5*OURC£ 



TRAA/SMI5^ro^ 



-9 OScXU.4T*>R -£ SCALXA/G 



^ P£5f£*Y 



E^er- 



"33 



Xrforh^OLtion 



Conceptually these five functional parts are disjoint. In every real 
mec hanical timepiece, however, the same physical part .ay serve in more 

m nspTLo to th nal Unit< Th6 1 Wheel tPain WhiCh ^— its'energy from h" 
mainspring to the escapement also performs part of the scaling between the 

ToTlZT f t°h S ' Cillat n nS and thG dlSPlay (di3l): bUt the wheel train 
a^ sciiino 1, 1 ° SCllla T t li or m0dule which *PP"™ between the transmission 
and scaling modules. The escape wheel is part of both the oscillator 
module and the wheel train. Other parts are also shared among modules 



/^N 
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WATCH 



.^«* 






WatcH 




5PRI/V<S 



VuHEEL 



SCREWS 



MAIa/ 
SPKXMG, 



STAFF LB.I/ER 



Fourth 

WHEGL 



C£NTBK 
WHB.BL 



% U/HB.£.L 



In this dia 3 ram - the structural and functional hierarchies are 
(partially) shown together. Notice that each not is a strict hierarchy, 
but almost is; and that the two almost-hierarchies are not the same, but 
are similar. In some places a single unit in one hierarchy is the same as 
a single unit in another (for example, the wheel train and transmission 
coincide). In other places what is a single unit in one hierarchy is 
spread out in the other (for example, the single functional idea of scaling 
is spread out in the structural hierarchy, while the wheel train and motion 

hier rrhvT ^ ^ haVe Varl ° US PUrp0ses in the functional 

It would be possible to design a timepiece which exhibited much 
less structural overlap between functional units, so that the structural 
and functional hierarchies would be almost identical. While such a 
timepiece would certainly exhibit "structured" design, in the sense of 
structured programming", it would be much less reliable (due to 
unnecessary duplication of parts to avoid overlap), and would be very 
difficult to make small enough to ride comfortably on one's wrist. 

Other engineered systems, such as electrical circuits and computer 
programs, exhibit a similar sharing of parts among uses. A strictly 
hierarchical description can be only an approximation to the true structure 
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at the expense of other equally valid or important ones. A given hierarchy 
may be violated because of constraints not visible within that h^erlrchy 

A good description explicitly acknowledges the sharing of structure 
in engineered devices. This can be captured as a locally hierarchical 
structure in which each feature is described and related to -l^er^J"- 
features which implement that feature, even though those sub-features Lv 
be spread throughout some other (also locally hierarchical) part of the 
description and used to implement other features as well. 

hierarchical ^rrTnt"* ^T" natUrally permits one to express almost- 
hierarchical descriptions, because its rules of composition are explicitly 
stated in terms of the sharing of parts. The rule of abstraction is 
hierarchical, but the rule of composition permits one to violate the 
hierarchy in any desired manner. violate the 



,^ 



r^, 



In fact, we have already used this feature to describe the 
connection of two resistors. One terminal of each resistor is shared wnJ 
a terminal of the node. Terminals are not very, interesting as they have To 
non-trivial internal structure. However, let us extend that example to 
demonstrate a more interesting almost-hierarchy example to 



series are 



. We first express the idea that two resistors in 
equivalent to a single resistor: 

= = > (constraint series -res is tors 
((rl resistor) 
(rZ resistor) 
(req resistor) 
(a adder)) 
' (.== (>> tl rl) (>> tl req)) 
(== (» U rZ) (» t 2 req)) 
(== (>> al a) (>> resistance rl)) 
<== (>> aZ a) (>> resistance rZ)) 
(== (>> sum a) (>> resistance req))) 
SERIES-RESISTORS 

U h savs th-,t n °^ Say ^ (>>Ureq) 1S electricallv connected to <>> „ n>. 

=£=£" saps .'::«-;:;: — :. srtrs 

it n „, I hlS definition does not ex P re ss the fact that we ordinarily apply 
it only to resistors which share a common node. This is a restriction on 
usaae of the constraint, rather than a restriction to". .„7orc ed £%„. 




Steele and Sussman ig 



Constraints 



f\ 



ser JL'^onitrifnt" Wp "*** ^^ ^^ " WiU enf ° rCe th « d " ired 
it to d th T C ° nstruct an inst ™« ^ the constraint, and use 
it to describe the resistors R44 and R43 connected earlier. 



--> (create srl series-resistors) 
SRI 

==> (== (>> rl srl) r43) 
IDENTITY 

== > (*« (>> rZ srl) r44) 
IDENTITY 



hptw! h6r " 8re tW ° s ^ltaneous ( redundant descriptions of what is going on 

between the upper and lower terminals of the circuit. Neither desfripUon 

s regarded as being "more real" than the other; we merely say that one or 

ist r a^T, T U1 f ° r "^ PUPP0Se - B ° th -»"iPtL, p as one 
re^xstor and as two, are equally valid. We can speak of 

escT;;; r ; e ij;v n esist r e of the resistor in the «*"«l-r«i.tor 

description, JUSt as well as Of (» resistance r43) or (» 1 tl r44) Which arP 

quantities of the two-resistor description. 

applications' 6 J**™**™ descr iptions have important computational 

descr p on ; f tl T^*' " ^ ^^ ^^ CirCUit the alternative 
description of the divider as a single resistor permits the deduction of 

the current through the divider. This in turn permits the deduction of the 

voltage at the midpoint! l ™ e 

*=> (what-is {>> v tl r44)) 
(>> V Tl R44) = 3.0 

circVit ha w!- d0ne . here . is t0 introdu « an alternative point of vi.w of the 
circuit While m principle it contains no extra information, the new 
viewpoint is better organized for certain purposes (such as determining the 
current through the divider). The constraint language permTts us to 

™ c : :zvr redundant viewpoints s ° ^ «■«> «■ ~" in° 

Let us add another resistor R45 to our circuit: 

W3 R« y RV5 

We can describe various series combinations within this circuit: 



Z *^ 
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u In thiS manner the flat three-resistor circuit can Hp 
hierarchically decomposed in at least three different way ) as three 

separate resistors; (2) as the series combination of the upper two " 
series with the lowest; (3) as the uppermost, in series with the series 
combination of the lower two. In a given circumstance one point of view 
may be more useful than another. Moreover, the various points of view"" 

^Is^hirarcny. 1 " * ^ ^^ ^ '» »° ~ ^ an' 



Constraints and Algebra 
It mirjht seem that in writing down and using constraints we are 

rm ^7is^rtt C ^T* * * ^^ «""»' ™™ZZi 
Inn ; , ° S ° me eXtent ' but U is not tn * entire picture The 

constraint language is a kind of "structured algebra* in Jhat we hive 

slTnT 7Ti Cal StrUCtUrGS WhlCh aU0W US t0 Manufacture and co m b ne 
systems of algebraic constraints to make larger systems. Additionally we 

rioeb^c ^ t T^ :: zz^lt j^sr™ r z 
z iy s?. t of eq r ions which desS - £™ «"r.s o7. B sr 

elation" " " ^ ^^ . dla8r » f ° r ^ ^ -t of 



/"**% 



Algebra has two components of interest On P ic * ™+.-- 
expressing constraints, and the other is J ? \ r \ n J or ~~ ?* 
which permit the derivation of conse.uences crlnV^ ^? * 



The reader may have noticed that the constraint language is ra 



ther 
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verbose In defining the numerical constraints in the RESISTOR constraint 
definition, we had to write out eight lines: constraint 



(== (>> v tl) (>> sum av)) 
(== (>> v t2) (>> al av)) 
(== (>> a2 av) (>> product m)) 
(== (>> i tl) (>> ml m)) 
(== resistance (>> mZ m)) 
(== (>> i tl) (» al ai)) 
(== (» i t2) (>> a2 ai)) 
(constant (>> sum ai) 0.0)) 

Using an algebraic notation, we might have written simply: 

(>> v tl) - (» v t2) = (» i tl) * resistance 
(>> i tl) + (>> i t2) = 0.0 

'uT^ C h ° nVent H i0n w 0rmally diCtat6S that Simpler variable names than 
(» vti) be used. We have used the same long names in the algebraic 

equation, not only for the sake of a "fair" comparison, but because names 

n ^ in °™ are CPitiCal t0 the almost-hierarchical composition of the 

tuns iidints . 

thronnh H 9ebralC "° tation is expression-oriented. It achieves conciseness 
through the use of functional composition. The relationship of arguments 

of lZV 10n , h S implicitly e *P res ^ by position, permitting the elimination 
of explicit description of the connections. For example, in expressing an 

^^! 1 » nC0 « Straint ^ thG constraint language, we explicitly mention the 
P PC . 1™ S A1> A2 ' and SUH of tne adder, and explicitly specify what they 
are linked to. In algebraic notation we simply write "a + b" The "+" 
denotes an adder constraint. The three connections to the adder 'constraint 
are expressed by position. Whatever is to the left of the »♦■ is connected 
to the ai pin; whatever is to the right of the " + " is connected to the A2 
Pin; and the sum pin is connected to the pin of whatever operator of which 
the entire expression stands as an argument. If we write "(a + b) * c» 
then the sum pin of the adder constraint is connected to the mi pin of the 
multiplier constraint. 

The connections indicated in an algebraic expression form a tree 
with connections to identifiers at the leaves, and a single oose 
connection coming "out the top". To connect the loose ends of two 

x p P ros S ."on S, i, W a U r ,e "^ ^ "^ *" ^™' ^ *n 
expression, is a constraint network with no loose ends (or rather the 

loose ends are explicitly indicated by the presence of identifiers) 

for mn The adVantages of algebraic notation are obvious. What do we pay 
for conciseness? Asymmetry. To a mathematician, the following th^ee 
statements say the same thing: lonowing tnree 
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E = K + U 



E - U 



U = E - K 



Each binary- operator must in principle have three forms, one for each of 
the three connections that may come "out the top" as opposed to ei 
ToZTTV : ar9UmentS "- < In the c... of additL and Tubtrac ton two 

S.t ,u ,?s-tr one of them is commutative - conside - h — «■• 



x = y* 



■■&r 



log y x 



ra WhlCh ex P re "es the same constraint in a different form. More 
generally, an n-ary operator with no symmetries on its pins requires nil 
distinct forms.) The constraint language preserves symmetry of expression 

ex trlTZTl™ PPimitiVe n ° taUOnS: b ° th ^itionsTnd subtract on "re 
expressed by the same constraint. The cost of this symmetry and economy in 
the constraint language is verbosity. economy in 



Algebra provides rules 
representations of a constraint. 



for transforming among equivalent 

n,TH- nr - h .u Glven tnis ' in some sen se it doesn't 

matter how they are written down. Equations express truth. 



Given a 



set of equations, we can easily draw the (uniauei 
constraint diagram which they represent. For example, for the set 



2*X + 3*Y = 6 
we draw the diagram 



5*X + 4*Y = 7 




the h result i0 nf represe ;. ts a piece of the ""work which is an unrooted tree, 
the result of connecting two rooted trees at their roots. The purpose of 

in order to make them printable as (necessarily tree-like) expressions. 
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When the separate tree-like pieces are printed, the identifiers indicate 
the cross-branch and inter-tree connections. 

For any given network, there may be more than one way to cut the 
loops. For example, we could use another variable U: 




We can then write this cut of the network as 

6 = U + 3 * ((7 - 5 * (U / 2)) / 4) 

Even for a given assignment of identifiers, one can write many different 
equations by choosing which (two-ended!) connection to use for the 
equality; the two parts of the equation tree are considered to be rooted 
at the ends of the chosen connection. Using the connections marked {a}, 
<b}, {c}, {d}, {e} we get these equations: 

{a} U = 2 * ((7 - 4 * ((6 - U) / 3)) / 5) 

' {b} U / 2 = ((7 - 4 * ((6 - U) / 3)) / 5) 

{c} 5 * (U / 2) = (7 - 4 * ((6 - U) / 3)) 

{d} (7 - 5 * (U / 2)) = 4 * ((6 - U) / 3) 

{e} 3 = (6 - U) / ((7 - 5 * (U / 2)) / 4) 

All of these equations represent the same network of relationships. 

nnp n^ U rl S ° f , C ° UrSe possible t0 use n)0re identifiers than necessary. 

f ' su f flces for our example, and it could have been put in any of six 

places We originally derived the diagram from two equations in two 

identifiers X and Y. We could use more than two if we desired to, for some 

eain?p ; tiT "^li 3lS °- a " i9n "^ ^ ° ne identifier t0 * connection, and 
equate the redundant identifiers. Taken to the extreme, this approaches 

Juantitv n h C a V° n i^ e i CiflCati0nS ° f thG COnstraint lan ^3e, wherein each 
quantity has multiple names which are equated. 



^ mm s. 
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1 e th.'l Sm " dia3rams a sin u 1<! connection may haye more than two "ends"- 

n the RlZZ^r H ^"i * l '"" i '" "" "»" *" "^ ™« "cur. 
the RESISTOR definition above. Now the implicit connection* i„ 

z;:":™ ": ta t "; n hav5 r y tw ° ends - when * «-™ »™ " " -d 

connectors is to be printed as a set of equations, such connectors must 
have identifiers assigned to them, because only identifiers can oLSS 
""'Ple-nnond connections in algebraic notation" After SU c h Tden 1 ier 

r«Vi , ;; I0 "vr d ' addmonal ones may ° r ^ -*. »• •••-.- *«,■ 



s 



The various ways of algebraically notating a set of relationshios 
are equivalent. A network of relationships simply exists It is ln th-! 
sense that we mean that constraint diagram's are Ure ^fundamental th e s 

of equations. Many algebraic laws (but not all) simply provide for 
transformations among sets of equations which represent th/same dfagramT 

hnwB1 W1 Jf" We begin t0 use the network for some computational purpose 

i - r ; lt :; : ° ue 7 s T of view becomes important - if - ^ *°™e 

some, output value(s) given certain "input" values, where all the valup* 
are related by some network of constraints, we must organize an inforlaUon 

Icy nc T" h T nGtWOrk - Intermediate computations must proceed along an 
acyclic path from inputs to output(s). 

So-called "algebraic" programming languages find algebraic notation 
a convenience because the tree implicit in the functional composxT^ri? 

^^\:Xi:' ^ thePe 1S " aSWtry t0 6aCh -nn^ctrn' from "o 

p P ^ "to an argument slot") which can be construed to imply the 
direction of information flow. The notation therefore requires the 
programmer not only to express relevant relationships but also 
simultaneously to specify the particular computational use to which the 
relationships will be put. Thus, for example', Ohm^s Law "s the "eqtt 
sL^lv write this , e iT r ° f *" " algebraic " Programing language cannot 

declarative language requires only the statement of relevant reUtlonshins 

denote single results. <Mu1 ll e 1e Va1 ""> Fnr pvnmnlo „. M expressions to 
tn rir,r-i„^ • . r exam P 1 e, there is generally no wav 

to define an integer division "function" which returns both n»nM»n7 a 
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computers) and embed a call to such a "function" in an expression 
an inherent property of t.r Pe , expression, 



This is 



for •shi W fMn°n inted ° Ut " arUer that algebPa pr0Vides transformation rules 



X = A B + A C <=> X = A (B + C) 
The networks for these two equations look like this: 

X 




does e nnr WP r kS ■? t0 ^ l ^^y distinct: one has a loop, and the other 
unsuitable for computing A. connection), and so is 



Steele and Sussman 



25 



Constraints 



r^ 



3.0 




■i mi 'r a ;' y ; "I?™ "l 0lVe an eqUation " ^ »««* the distributive 



/*"*N 



law, we in effect 
which preserves 
tree to be found 



impose another piece of network- nn +h a ,->*^„- t 
-hie preserves «,. ,«.„„„ „, J„. r.u.Sr^TS: 
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Computing with Constraints 

can be ^ibld* "^J " 8 We have ""formed with constraint networks 
oe described as simple propagation of known values Vaii.«« *.-- 
Propagated through primitive constraints and through equanties^ bv "one! 
step deductions". (Propa 9 atlon > primiMvn r*™.*- • . M uies Dy one 

i.c.1 cens „ hich . c .„,i„„.i T:;z TTii: ar r r°u" sts r tainin9 
Tut ::\Ts as r ciate ? with "• a -^™~n - cH/ : y 

of its « * a T • a " d " " "" l0Cally detc ™ 1 " e «•« v.!„e Jf one 
d d.ced v, lu e I™ Z t Tn A C ,n other ,« lls ' " ""i ""el... ... 

to another cell" gets a va> f n„al y ° r'cen" 1 " 6 F bei " 3 e " Ual 

rr - a valU e by the _ or u ; y s,^z c ;: bl s 



reason <»"-»"" ,•■« «» ""oci.ted value, it also has associated with it a 

tb0 value was obtained from other cells thro„„h a 
prrautive constraint, then the reason mentions those other cells Z the 
Particular rule of the primitive constraint used to make the deduction U 

«nti v ™,"\;;" Sirvsr r equality - ltn onothEr »»■ *"« ' »••« 

points to the user or to t L WaS f^T 11 * aSSl9 " ed ' the """" 
("dependencies" , " , ySt ™ (coK « NT >- These reasons 

I dependencies ) ore easily, constructed as the deductions are made- thov 

iy.m the network. These markers can be traced at any time for surh 

"n G : ^ e finding the a » teced * nt assumptions of a deduced value": 
locating the consequences of a value. These may be in turn used for 

of "s crse" ^'T^ for """"« °' • -er-supplied assumption and a 

vine beck i'rr.ni:: r h r e seen) - in addmon - if ° ne tr — ^ ■ 

with th! , I a "tecedent assumptions, the part of the network traced 
with the directionality imposed by the dependency markers, constitutes a 
formula for computing the value. Compiling Constraints) constitutes a 

reason ^/LT^ 1 * ^ * CBU be aSSi9ned a value for ™™ than one 
reason If two values collide at a cell they must be the same If tZl 

are not, and if the network represents a satisfiable set of constraints 

there is an inconsistent set of assumed values. The dependencies car hp 

use to determine the subset of the set of assumed values "Tnconsistenf 

This can be helpful in dealing with very large networks w h n f f 

^alTsub^ r r ° 3ny ° ne -Miction ^icanrd^en^rL ' y ° 
^raaii suoset of the many assumptions. 

In a satisfiable constraint network, the values which win k 
they arc fomented hy means of a w cue or agenda i°„ our current' sysccT 
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We have already discussed how redundant descriptions may be used to bypass 
such loops by superimposing an equivalent tree structure. Another, related 
strategy involves the use of symbolic algebraic manipulation. If we enable 
the primitive constraints to propagate symbolic expressions as well as 
numerical values, we can use powerful algebraic manipulators to propagate 
past loops. If for example, in the problem above, we put the symbolic 
value,. "X" on (>> ai zap) then zap may deduce that its m is 5-X, 
"Simultaneously" foo may deduce that its mi is X/l. These values are on 
cells declared to be equal; thus an equation may be formed, X/i = 5-X, and 
solved algebraically. Once the value of X has been determined, then the 
numerical values for the propagated symbolic expressions can be computed 
(or at least expressions involving X and possibly other variables can 
perhaps be simplified). 

Algebraic techniques of this sort were used in such systems as EL, 

M^ -inri cvM (Algebraic Propagation} T . . '•^„ m , *_ » ,, ^ 

o, ana din. y K y It is easy to see, however, that 

propagation of symbolic expressions in effect makes copies of tree-like 

portions of the network; each expression is a history of the portion of 

the network through which its pieces were derived. The algebraic 

techniques applied to these expressions might as well have been applied 

directly to the network. Instead of applying the distributive law to an 

algebraic expression, for example, one might as well just attach that extra 

point of 'view to the network. The implications of this idea have just 

barely begun to be explored. 
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Notes 

{Algebraic Propagation}. We have used propagation of algebraic expressions 
in our work on analysis and synthesis of circuits. (Propagatlon} Although we 
have used algebraic manipulation techniques (extracted from MACSYMA 
[MACSYMA]) far .more powerful than people generally use, we have found that 
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these techniques are not, by themselves, powerful enough to solve manv 
interesting problems which people can solve. People generally solve these 

of n Gm bv us° rCJaniZin H 9 T S ° 1Uti0n S ° th3t °" ly Simple «*«" is recused 
co n!ex IZ " 9 77 the ° remS ' Wh ° Se Pr °° fS PerhapS re « uired tremendously 
prol blv at fh rV nCe K a " d f0P a " ^ a Cl6Ver PerS0 " Wh0se name i* 
a . T he thC ° rem) ' bUt Wh0Se »PP""tion does not require 
complex algebra). To avoid tremendous symbolic computations, computers 
must also have good methods of avoiding doing all except the most trivial 
a gera problems We have used multiple redundant descriptions [L^n 

o ol v nte th^ "* e / ayS ° f l0 ° kln9 St 3 PPOblem Which are organized so as 
to obviate the need for extensive algebraic manipulation. 

snpMfJ'" 9 * onst T aints >- The idea of extracting procedures for computing 

wn 9^8 Ue \ " a h C ° nStraint nGtWOrk " bein9 PUrSUed by RichardVown 
Lurown 1978]. Borning has also done work in this area. <Thin 9 Lab > 

{Dependencies}. TOPLE [NcDermott 1974] was an early attempt to record the 

^b;: p S ,r ng V UCUOnS f ° r the PUPP0Se ° f -fining consistency in 
a data base when newly introduced facts conflicted with existing ones. The 

T^ZTZ r" ;° nSUltant [Fik6S 1975] made USe of tendencies ": 

earch HYCIN ?Jh .vrT^ ° f '"^ bUt d " " 0t US6 them t0 Cont rol 
search mciN [Shortliffe 1974] [Davis 1976] [Shortliffe 1976] used 

dependency information to produce explanations, but did not use it for any 

"cue e.nTT EL C / USSman & StaUman 1975] USed ^pendencies to 
produce explanations and also to limit the recomputation required in 

response to incremental changes in the assumptions. Stallman and Sussman 
described a general means of limiting combinatorial search by the analysis 
rstinn" T y , ChainS and the USe ° f multiple laical supports for fac s 

blk tlTr • » a ", 1977L ThlS meth ° d ' Called "^Pendency-directed 
backtracking was independently discovered by Jim Stansfield (unpublished 

he D f ln ' rthes" f ' Un i VGrSity ° f EdinbUPgh " thS "" WaS edited out of 
the final thesis for unknown reasons). This method is superior to the more 

familiar chronological backtracking", introduced by Floyd [Floyd 1967] and 
best known for its use in AI languages beginning with PLANNER [Hewitt 1972] 
and Nicro.-PLANNER [Sussman, Winograd, & Charniak 1971], in that it avoids 
the irrelevant dependencies assumed by the system on the basis of 
19771 f, tin T 1 , 091 " 1 ° rderings of actions [Sussman & NcDermott 

?ru h [ 'h r T an 1977L D ° yle CD ° yle 1977] deve l°Ped a portable 

Truth Maintenance System" which encapsulates a careful theory of 

dependencies, dependency-directed backtracking and non-monotonic inference 

A ""pier system for dependencies and backtracking was developed in 

IcAllester 1978]. NcDermott and Doyle have produced an elegant semantic 

o7 ^"-"--^"ie inference which is described in [NcDermott & D y e 

1978]. Phil London of University of Maryland has used dependencies to aid 

in keeping track of assumptions in the world model used by a problem 

solving system [London 1978]. y P rot) lem 

{Elements}. Euclid had a point here. 
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Chnnnh io.\ SlmP l e f mPle ° f ™ Ch a ruU ls that of l^bda-abstraction 
evn p iL ] h in 1Ch * laBbda - ex P«»i«>n packages up a possibly compound 
expre s on and an inter/ace specification in the form of a variable name 
i in LISP, variables names). 

{Multiple Values}. There are a few languages which permit a routine to 
return more than one value (other than by side effect of a reference 
parameter as in FORTRAN). In SL5 every expression implicitly carries two 

POpT Vnd ran™ ""I 1 ? ^ 3 SUCcess/failure f l^- Languages such as 

POP2 and FORTH are stack-based, and routines both receive arguments and 
return values on the stack. APL and LISP do not have multiple-valued 
expressions. A common trick is to construct a data structure (an array or 
a list) which contains several distinct values' to be returned; but the 
called routine must explicitly construct this structure, and the caller 
must then explicitly decompose it. 

{Other Languages}. Some' examples of languages which are less organized 
^Ttmm! 1 ? n ° UOn ° f procefiure are such simulation systems as DYNAMO, GPSS, 

{Propagation}. "Propagation of constraints" was originally invented as a 
generalization of "Guillemin's method" of analyzing electrical ladder 
i07ri ltS ', AI !~ ™* "*** in the analysis programs EL [Sussman & Stallman 
l-7o] and ARS [Stallman & Sussman 1977], and in the synthesis program SYN 
[do kleer & Sussman 1978]. The basic idea of the method was first 
described in [Brown 1975] as part of a method for localizing faults in 
electrical circuits. De kleer also used propagation analysis in his fault 
localizer [de kleer 1976]. Sutherland [Sutherland 1963] appears to have 
developed a similar technique (the "One Pass Method") for constraint 
satisfaction in Sketchpad. 

{ThingLab}. Our method of specifying an object by a set of subparts and a 
set of identifications of sub-subparts is essentially the same as that 
independently developed by Alan Doming, a graduate student at Stanford 
University. In his Ph.D. thesis (forthcoming), entitled "ThingLab - A 
Simulation Laboratory", Borning develops an interactive system (written in 
Smalltalk [Goldberg & kay 1976]) for simulating the effects of constraints 
ThingLab provides a beautiful and convenient graphics interface controlled 
by the constraint network. In contrast to the system described here 
ThingLab does not retain dependency information, and uses relaxation 
techniques (rather than algebra or multiple redundant views) to deal with 
systems not directly amenable to simple propagation. In these respects 
ThingLab is very similar to Sketchpad [Sutherland 1963]. Unlike Sketchpad, 
ThjngUb provides facilities for incrementally compiling constraints, as 
well as a non-graphical, programming-language notation for the constraints 
[Borning 1977] is a preliminary description of ThingLab's capabilities! 
What we have referred to as identification of parts Borning, following 
Sutherland, calls "merging". This is because in both systems data 
structures representing identified objects are actually merged internally 
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to become a single data structure This <« „„+ a 

system because the fact of such ,n /h I * " ° Ur cons ^^ 

recorded for the sake of th/ H- identification must be explicitly 
in the other two systems) " ""* lnf ° rmati ° n < which *« not included 
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